ORTHOGONAL BUNDLES OVER CURVES IN CHARACTERISTIC TWO 



CHRISTIAN PAULY 



Abstract. Let A be a smooth projective curve of genus g > 2 defined over a field of characteristic 
two. We give examples of stable orthogonal bundles with unstable underlying vector bundles and 
use them to give counterexamples to Behrend's conjecture on the canonical reduction of principal 
G-bundles for G = SO(n) with n > 7. 

O 

q ' Let X be a smooth projective curve of genus g > 2 and let G be a connected reductive linear 

algebraic group defined over a field k of arbitrary characteristic. One associates to any principal 
G-bundle Eq over X a reduction Ep of Eq to a parabolic subgroup P C G, the so-called canonical 
| reduction — see e.g. |Raj . [Be] . |BH] or [H] for its definition. We only mention here that in the 
case G = GL(n) the canonical reduction coincides with the Harder- Narasimhan filtration of the 
^ ■ rank-ra vector bundle associated to E G . 



< 



In |Bej (Conjecture 7.6) K. Behrend conjectured that for any principal G-bundle Eq over X the 
canonical reduction Ep has no infinitesimal deformations, or equivalently, that the vector space 
H°(X, Ep x p q/p) is zero. Here p and q are the Lie algebras of P and G respectively. Behrend's 
conjecture implies that the canonical reduction Ep is defined over the same base field as Eg- 

(N ■ 

>- ■ We note that this conjecture holds for the structure groups GL(n) and Sp(2n) in any character- 

istic, and also for SO(n) in any characteristic different from two — see [H] section 2. On the other 
hand, a counterexample to Behrend's conjecture for the exceptional group G 2 in characteristic 
two has been constructed recently by J. Heinloth in [H] section 5. 

In this note we focus on SO(n)-bundles in characteristic two. As a starting point we consider 
the rank-2 vector bundle F^L given by the direct image under the Frobenius map F of a line 
bundle L over the curve X and observe (Proposition I4.4|) that the SO(3)-bundle A := Endo(i ? *L) 
is stable, but that its underlying vector bundle is unstable and, in particular, destabilized by the 
rank-2 vector bundle F*Ox- We use this observation to show that the SO(7)-bundle 

F*O x ® (F*Ox)* ® A 

equipped with the natural quadratic form gives a counterexample to Behrend's conjecture. Re- 
placing ^4. by ^4. = End(F^L) we obtain in the same way a counterexample for SO(8), and more 
generally for SO(n) with n > 7 after adding direct summands of hyperbolic planes. Note that 
Behrend's conjecture holds for SO(n) with n < 6 because of the exceptional isomorphisms with 
other classical groups. 

The first three sections are quite elementary and recall well-known facts on quadratic forms, 
orthogonal groups and their Lie algebras, as well as orthogonal bundles in characteristic two. 
In the last section we give an example (Proposition 16. ip of an unstable SO(7)-bundle having its 
canonical reduction only defined after an inseparable extension of the base field. 

This note can be considered as an appendix to the recent paper [H] by J. Heinloth, whom I 
would like to thank for useful discussions. 
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1. Quadratic forms in characteristic two 

The purpose of this section is to recall definitions and basic properties of quadratic forms in 
characteristic two. 

Let k be an algebraically closed field of characteristic two and let V be a vector space of 
dimension n over k. We denote by Sym 2 V^ and A 2 V the symmetric and exterior square of V and 
by F(V) := V ®fc k the Frobenius-twist of V. We observe that there exists a well-defined fc-linear 
inject ive map 

F(V)^$ym 2 V v®\^ \(vv), 

where v-v denotes the symmetric square of v. More precisely, we have the following exact sequence 
of /c-vector spaces 

— ► F(V) — ► SymV — > A 2 V — ► 0. 
Let a denote the involution on V <8> V defined by a(v <&w) = w®v and let §2(V) dV ®V denote 
the o"-invariant subspace. Then one has the exact sequence 

o — ► § 2 (v) — ► v <g> v — ► aV — ► o, 

where the last arrow denotes the canonical projection of V <S> V onto A 2 V. By choosing a basis 
of V, it can be checked that the image of §2(V") under the canonical projection V <8> V — > Sym 2 V 
equals the subspace F(V). 

By definition a quadratic form on the vector space V is an element Q G Sym 2 (V*). Equivalently, 
see e.g. |Boj section 23.5, a quadratic form can be seen as a fc-valued function on V such that 

Q(av + bw) = a 2 Q{y) + b 2 Q{w) + abfl(v, w) a,b G k;v,w G V, 

where (3 is a bilinear form on V. The bilinear form f3 associated to a quadratic form Q is determined 
by the formula 

/3(v, w) = Q(v + w) + Q(v) + Q(w). 

Is is clear that (3 is symmetric, hence f3 can be regarded as an element in §2(V™). The assignment 
Q I— > (3 gives rise to the fc-linear polarisation map 

V : Sym 2 (V*) — > S 2 (F*), Q ^ /?. 

Over a field of characteristic different from 2 we recall that the polarisation map V is an 
isomorphism. In our situation one can easily work out that 

ker V = F(V*) and coker V = F(V*). 

Quadratic forms Q G ker V correspond to squares of linear forms on V and the last equality 
asserts that the bilinear form (3 is alternating, i.e., (3{y,v) = for all v G V. 

We say that Q is non- degenerate if (3 induces an isomorphism (3 : V — > V* for n even, and if 
dim ker f3 = 1 and Q\^ er p ^ for n odd. We say that a linear subspace W C V is isotropic for Q 
if O u 0. 

2. Orthogonal groups and their Lie algebras in characteristic two 

In this section we work out in detail the structure of the Lie algebras of the orthogonal groups 
SO (7) and SO (8) over a field k of characteristic two, as well as of some of their parabolic subgroups 
P C SO(n). Following the principle of [Hj, we describe the representation so(n)/p of the Levi 
subgroup L C P, which we will use later in section 5. The main reference is |Boj section 23.6. 

By definition the orthogonal group 0(n) is the subgroup of GL(n) = GL(V) stabilizing a non- 
degenerate quadratic form Q G Sym 2 (V*). Note that in characteristic two O(n) C SL(n). We 
also recall that, if n is odd, the group O(n) is connected. If n is even, O(n) has two connected 
components distinguished by the Dickson invariant QD] page 301). In order to keep the same 
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notation as in characteristic 7^ 2, we denote by SO(n) the connected component of O(n) containing 
the identity. 

2.1. The group SO (8). We consider V = k 8 endowed with the non-degenerate quadratic form 

Q = x,x 7 + x 2 x 8 + x 3 x 5 + x 4 x 6 e Sym 2 (V*). 

We choose this non-standard quadratic form in order to obtain a simple description of the Lie 
algebra p of the parabolic subgroup P fixing an isotropic 2-plane, which will appear in section 5. 
The bilinear form (3 associated to Q is given by the matrix 



( 








I \ 
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) 



where I denotes the identity matrix y Q 1 J and O the zero 2x2 matrix. A straightforward 

computation shows that the Lie algebra so (8) C End(V) of SO(8) consists of the matrices of the 
form 



(1) 



fx, 


x 2 


x 3 






x. 


x 5 




'Xs 




x 6 




f x 5 


l x 2 




V D 4 


*x 6 


l x, 


*x x 


) 



where the X t are 2x2 matrices, the t X i denote their transpose, and the Di denote matrices of 
the form ( ° ^ V 

We consider the maximal parabolic subgroup P C SO (8) preserving the isotropic 2-plane W C 
V = k 8 defined by the equations Xj = for i — 3, . . . , 8. Its orthogonal space W 1 - is then defined 
by the equations x 7 = x 8 = 0. The Levi subgroup L C P is isomorphic to GL(2) x SO (4). The 
Lie algebra p of P consists of the matrices (pQ) that satisfy the conditions 

X 4 = Xq = and D 4 = 0. 

The vector space so(8)/p sits naturally in the exact sequence 

(2) — >Rom(W,W ± /W) — >so(8)/p — >V — ► 0, 

where T> is the one-dimensional subspace generated by the element e8/ + /8e6 W* <g) W* = 
Hom(W / , W*) = Hom(W, V/W^), where e and / are linearly independent. 

2.2. The group SO (7). We consider V = k 7 endowed with the non-degenerate quadratic form 

Q = XiXq + x 2 xj + X3X4 + x\ e Sym 2 (l^*). 
The bilinear form f3 associated to Q is given by the 7x7 matrix 
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The radical ker/3 of Q is generated by e$. A straightforward computation shows that the Lie 
algebra so (7) C End(V) of SO(7) consists of the matrices of the form 



(3) 



fx, 


x 2 
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where the X{ are 2x1 matrices and A is a diagonal matrix of the form I Q ^ J. We consider the 

maximal parabolic subgroup P C SO (7) preserving the isotropic 2-plane W C V = k 7 defined by 
the equations Xi — for i — 3, . . . , 7. Its orthogonal space W 1 is then defined by the equations 
xq = = 0. The Levi subgroup L C P is isomorphic to GL(2) x SO(3). The Lie algebra p of P 
consists of the matrices ([3]) that satisfy the conditions 

X 3 = 0, x x = 0, and D 2 = 0. 

As above we have an exact sequence 

(4) — ► Hom(W, W ± /W) — >so(7)/p — > V — ► 0. 

3. Orthogonal bundles 

By definition an orthogonal bundle over a smooth projective curve X defined over an alge- 
braically closed field k is a principal 0(n)-bundle over X, which we denote by Eo< n ). Equiv- 
alently a 0(n)-bundle corresponds to a pair (S,Q), where S is the underlying rank-n vector 
bundle and Q is a non-degenerate O^-valued quadratic form on S, i.e., a non-degenerate element 
Q E H°(X, Sym 2 (£*)). By abuse of notation we will write £o(n) = Q)- 

One observes (see e.g. [Ram] Definition 4.1) that the notion of (semi-)stability of the O(n)- 
bundle Eo(n) translates into the following condition on the pair (£,Q): we say that (S,Q) is 
semi-stable (resp. stable) as an orthogonal bundle if and only if 

deff J~ 

ri?) ■= -£jr ^ ( res P- < °) 

for all isotropic subbundles T C £. 

A noteworthy result is the following 

Proposition 3.1 QRamJ Proposition 4.2). Assume that the characteristic of k is different from 
two. The pair (S, Q) is semi-stable as an orthogonal bundle if and only if the underlying vector 
bundle S is semi-stable. 

In the next section we will show that the assumption on the characteristic can not be removed. 

4. Stable orthogonal bundles with unstable underlying bundle 

We denote by F : X — > X the absolute Frobenius of the curve X of genus g > 2 defined over 
an algebraically closed field k of characteristic two. We denote by Kx the canonical line bundle 
of X. 

4.1. An orthogonal rank-3 bundle. Let E be a rank-2 vector bundle of arbitrary degree over X. 
The determinant endows the bundle Endo(-E') of traceless endomorphisms of E with an (9x- v ahied 
non-degenerate quadratic form 

det : End (£) — ► X - 

Its associated bilinear form j3 is given by /3(v,w) = Tr(t> o w) for u, v local sections of End (_E') 
and the radical of det equals the line subbundle Ox End (-E) of homotheties. 

Lemma 4.1. There is an exact sequence 

(5) — ► Ox — ► End (£) — ► F*(E) ® (det E)' 1 — ► 0, 
where the first homomorphism is the inclusion of homotheties into Endo(-B'). 
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Proof. Consider V = k 2 and W = End (V) equipped with the determinant. Note that for any 
g G GL(V) the conjugation C g : W — ■> W is orthogonal and leaves the identity Id invariant. 
Thus we obtain group homomorphisms GL(V) — > SO(W) — > GL(W/(Id}), g C g i-> C g . A 
straightforward computation shows that the composite map is given by g \— > ^^F(g), where F(g) 
is the Frobenius-twist of g. □ 

Proposition 4.2. 2/22 «s stable, then (Endo (2?) , det) zs stable as an orthogonal bundle. 

Proof. It suffices to observe that an isotropic line subbundle M of End (22) corresponds to a 
nonzero homomorphism : 22 — > E®M~ l of rank 1. If L denotes the line bundle im0 C 22(g) M~ x , 
we obtain the inequalities [J,(E) < degL < /i(E <g> M -1 ), which implies degM < 0. □ 



Let B denote the sheaf of locally exact differentials |Ray| , which can be defined as the cokernel 
(6) — > O x — > — > B — -> 0, 

of the inclusion Ox F*Ox given by the Frobenius map. Note that in characteristic 2 the sheaf 
B is a theta-characteristic, i.e., B 2 = K X - We denote by e G Ext 1 (B, Ox) = H l (X, B^ 1 ) the 
non-zero extension class (unique up to a scalar) determined by the exact sequence ([6]). The next 
lemma immediately follows from the definition of e (see also [Ray]). 

Lemma 4.3. The extension class e generates the one- dimensional kernel of the Frobenius map, 
i.e., 

(e) = ker (F : H\X, 2T 1 ) — > 22 1 (X,2T X 1 )) . 
In particular, we have a direct sum 

F*(F*Ox) = O x ®K x . 



Let L be a line bundle of arbitrary degree. Then the rank-2 vector bundle F*L has determinant 
equal to B ® L, is stable and is destabilized by pull-back by the Frobenius map F ( |LPj ). More 
precisely, the bundle F*(F*L) ® £> _1 <g> is the unique non-split extension (see e.g. |LSJ) 

(7) — ► B F^F^^B- 1 &L- 1 2T 1 — ► 0. 

Proposition 4.4. (i) T/ie vector bundle A := End (F*L) does not depend on L. 

(ii) TTie vector bundle A is the unique non-split extension 

— 2% ^ 2T 1 — 0. 

We denote by and ip generators of the one- dimensional spaces Hom^Ox, A) and 
Rom^B- 1 ). 

(iii) The restriction of the quadratic form det to the subbundle F*Ox equals the evaluation 
morphism F*F*Ox — ► Ox- In particular the restriction of (5 to F*Ox is identically zero. 

(iv) Let x and y be local sections of F*Ox and A. Then the two bilinear forms /3((f>(x),y) and 
(x,i()(y)) on the product F*Ox X A differ by a non-zero multiplicative scalar. Here (.,.) 
denotes the standard pairing between F*Ox and its dual (F*Ox)*- 

Proof. First we consider the exact sequence §5§ for the bundle F*L 

— > Ox — ► End (F*L) — ► F*(F*L) g> 2T 1 ® L' 1 — ► 0, 

and call its extension class /. In order to show that there exists an inclusion F*Ox c — ► Endo^L), 
it is enough to show that / pulls-back to e under the inclusion i : B <^-> F*(F*L) <S> B^ 1 g) L^ 1 . 
Since by Lemma 14.31 the extension class e is characterized by the equality F(e) = and since 
pull-back commutes with Frobenius, it suffices to show that the extension 

F*End (F,L) = End {F*F,L) = End Q (F*(F*L) <g> 2T 1 <g> L' 1 ) 
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contains the line subbundle K x = F*B and that t*(f) ^ 0. Since F*(F*L) ® B~ l ® L~ l is the 
non-split extension (J7]), we obtain a sheaf inclusion 

(8) K x = Rom(B~ l ,B) — ► End (F*F,L), h-> t o o tt. 
Using a degree argument, one shows that there is an exact sequence 

(9) — > O x © K x — > End (F*F,L) — ► Hom(B, 5" 1 ) = AT* 1 — > 0. 

It remains to check that t*(f) ^ 0. Suppose on the contrary that £*(/) = 0. Then B is a line 
subbundle of Endo(F*L) , hence we obtain a non-zero homomorphism F*L — > (F*L)©.B _1 . But i^L 
is stable and n(F*L) > n(F^L®B^ 1 ) = n(F*L) + l—g, which implies Hom(F„L, (F*L) ©i? -1 ) = 0, 
a contradiction. Thus we have shown that Endo(-F*£) fits into the exact sequence 

— > F,Ox — ► End (F*L) — ► B' 1 — ► 0. 

We denote by a its extension class in Ext^-B -1 , F,O x ) = H X {X, {F*O x )®B). We have (F*O x ) ® 
S = (F*0 X )* ® K x and by Serre duality H\X, {F,O x ) ® B) = H°(X, F,O x )* = H°(X, O x )\ 
which implies that dim Ext (.B -1 , F*O x ) = 1. Hence there exists (up to isomorphism) a unique 
non-split extension of B^ 1 by F*O x . In order to show assertions (i) and (ii) it will be enough 
to check that a ^ 0. But the push-out of a under the map F*O x — > B gives the non-split 
extension of B^ 1 by B, which proves the claim. The proof of the equalities dim Horn (F* O x , A) = 
dimHom(^4, B^ 1 ) = 1 is standard. Note that dHJ) is the pull-back under F of the exact sequence 
in (ii). 

The restriction of the bilinear form (3 to F*O x is identically zero, since f3 factorizes through 
the line bundle quotient B and (3 is alternating (see section 1). Hence the restriction of the 
quadratic form det lies in F*(F*O x )* C Sym 2 (F*0x)*, he., corresponds to an Ox-linear map 
a : F*F*O x = O x © K x — > O x . We note that a\o x = id and ct\K x = 0> since the summand K x 
corresponds to nilpotent endomorphisms — see ([8]). This proves (iii). 

Finally we observe that the bilinear form (x,y) t—> j3(<b(x),y) factorizes through the quotient 
B x B~ l , since (3 is identically zero on F*O x by part (iii) and since the radical of (3 equals O x . 
On the other hand it is easily seen that the bilinear form (x, y) i— > (x, ip(y)) also factorizes through 
B x B _1 , which proves (iv). □ 

Since F*O x is stable and fj,(F*O x ) = > 0, we deduce that the Harder- Narasimhan filtration 
of A is 

C F,O x C A. 

However, since F*L is stable, Proposition 14. 21 implies that the orthogonal bundle (A, det) is stable. 

Remark. Similarly, it can be shown that the rank-4 vector bundle A := End(-F*L) does not 
depend on the line bundle L, that it fits into the exact sequence 

— ► F*O x — ► End(F*L) — > {F,O x )* — > 0, 

giving its Harder- Narasimhan filtration, and that (A, det) is a stable orthogonal bundle. 
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4.2. An orthogonal rank-4 bundle. Besides the example given in the last remark of section 
3.1, we can consider the unstable decomposable rank-4 vector bundle 

B = F*O x © (F*O x )* 

and endow it with the Cx-valued quadratic form 

Q(x + x*) = q(x) + q*(x*) + (x, x*), 

where x, x* are local sections of the rank-2 bundles F*Ox and (F*Ox)* respectively. The bracket 
(x, x*) denotes the standard pairing between F^Ox and its dual (F*Ox)* and q, q* are projections 
onto Ox of the direct sums (see Lemma 14.31) 

(10) F* (F*O x ) = Ox®K x , F* (F*O x )* = O x ® K x \ 

It is clear that Q is non-degenerate and that Q restricts to q and q* on the direct summands F*Ox 
and (F*O x )* respectively. 

Proposition 4.5. The orthogonal rank-4 bundle (£>, Q) is stable. 

Proof. Let M be an isotropic line subbundle of F*Ox © [F*Ox)* and assume that degM > 0. By 
stability of (F*O x )* the line bundle M is contained in F#Ox, which gives by adjunction a nonzero 
map F*M — > F*F*Ox — > Ox, contradicting isotropy of M. Next, let S be an isotropic rank-2 
subbundle of FJDx © (F*Ox)* and assume n(S) > 0. By the previous considerations S is stable, 
hence there is no non-zero map S — > (F*Ox)*- Therefore S is a rank-2 subsheaf of F*O x , but 
this contradicts isotropy of S. □ 

Remark. Clearly the two bundles A and B are non-isomorphic. 

5. Counterexamples to Behrend's conjecture 
We consider the rank-7 vector bundle 

£ = F*O x ®A®{F«OxY 
equipped with the non-degenerate quadratic form Q defined by 

Q(x + y + x*) = (x, x*) + det y, 

where x, x* and y are local sections of F*Ox, {F*Ox)* and A respectively. Note that the SO(7)- 
bundle E S o{7) = (£, Q) has a reduction to the Levi subgroup 

L = GL(2) x SO(3) C P C SO(7) 

and that its L-bundle El given by the pair (F*Ox,A) is stable, since F*Ox and A are stable 
GL(2)— and SO(3)-bundles respectively. Since fj,(F*Ox) > n(A) = 0, we obtain that the canonical 
reduction of the unstable SO(7)-bundle (£,Q) is given by the P-bundle Ep := El x l P. Using 
the exact sequence (jlj we obtain the equality 

Rom(F*O x ,A) = H°(X,E P x p 5 o(7)/p). 

Note that H°(X,E P x p V) C Hom(F,C x , (F*O x )*) = by stability of F*0 X - But the former 
space is nonzero by Proposition 14.41 (ii). Hence this provides a counterexample to Behrend's 
conjecture. 

The following unstable SO(8)-bundles also provide counterexamples to Behrend's conjecture 

F,O x © A © {F*OxT and F*O x ®B® (F*O x )\ 

with the quadratic form given by the standard hyperbolic form on the two summands F*Ox © 
(F*Ox)* and the quadratic forms on A and B introduced in sections 4.1 and 4.2. Similarly 
we use the exact sequence §2§ and Proposition 14.41 (ii) to show that the corresponding spaces 
H°(X,E P x p so(8)/p) are non-zero. 
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Remark. One can work out the relationship between the unstable SO(7)-bundle (S,Q) and 
the unstable G 2 -bundle Eq 2 constructed in [H] section 5: first, we recall that G 2 C GL(6). 
Consider the symplectic rank-6 bundle E obtained from (E, Q) under the purely inseparable group 
homomorphism SO(7) — > Sp(6) C GL(6). Then the bundle E has a reduction to Eq 2 . 

6. Non-rationality of the canonical reduction of an SO(7)-bundle 

This section is largely inspired by the last remark of [Hj. We consider the unstable SO(7)-bundle 
(£, Q) introduced in section 5. We denote by K the field k(t), by X K the curve X x k K and by 
Ek the vector bundle over Xk obtained as pull-back of E under the field extension K/k. We will 
consider the quadratic form Q K on the bundle Ek defined by 

Qk(x + y + x*) = (x, x*) + det y + tq(x), 

where x,x* and y are local sections of F*Ox, (F*Ox)* and A respectively and q is the quadratic 
form on F*Ox defined in (TIP]) . Note that by Proposition 14.41 (hi) one has q(x) = det(0(x)). 

Proposition 6.1. (i) The quadratic form Q % is non- degenerate. 

(ii) The canonical reduction of the SO(7)-bundle (Ek,Qk) over Xk is not defined over K, but 
only over the inseparable quadratic extension K' = K[s]/(s 2 — t). 

Proof. We consider the vector bundle Ek 1 over Xk> obtained from Ek under the field extension 
K' /K and introduce the automorphism g s of Ek 1 defined by the matrix 

ld Ft0x \ 

s0 Id^ 
si> Id {F *o x )* J 

We choose the generators <fi G Hom(F*0x, A) and ip G Hom(^4, -B -1 ) such that /3(</>(x),y) = 
(x, ip{y)) for any local sections x, y of F*Ox and A respectively — see Proposition (14. 4p (iv). Note 
that g s is an involution. Then we have 

g s (x, y, x*) = (x, y + s(f)(x),x* + sip(y)). 

We also denote by Q and Qk the quadratic forms on Ek< obtained from Q and Qk under the field 
extensions K'/k and K'/K respectively. Then we have the equality 

(11) Q(g B (x, y, x*)) = Q(x, y, x*) + s 2 q(x) = Q K (x, y, x*), 

i.e., the quadratic forms Q and Qk on £k> differ by the automorphism g s . In particular Qk is 
non-degenerate and the pair (Ek,Qk) determines an SO(7)-bundle over the curve X K - 

Because of ffTTl) the canonical reduction of the SO(7)-bundle (Ek, Qk) is given by the isotropic 
rank-2 vector bundle a : F*Ox ^ Ek 1 with a(x) = (x, scj)(x), 0) for any local section x of F*Ox- 
It is clear that the inclusion a is not defined over K. □ 
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